Data processing level

PDS archives include data at various processing levels from raw to highly derived. The PDS4 processing levels are shown in the table below.

PDS processing level Description

Telemetry

An encoded byte stream used to transfer data from one or more instruments to temporary storage where the raw instrument data will be extracted. PDS does not archive telemetry data.

Raw

Original data from an instrument. If compression, reformatting, packetization, or other translation has been applied to facilitate data transmission or storage, those processes will be reversed so that the archived data are in a PDS approved archive format. Often call EDRs (Experimental Data Records).

Partially Processed

Data that have been processed beyond the raw stage but which have not yet reached calibrated status. These and more highly processed products are often called RDRs (Reduced Data Records).

Calibrated

Data converted to physical units, which makes values independent of the instrument.

Derived

Results that have been distilled from one or more calibrated data products (for example, maps, gravity or magnetic fields, or ring particle size distributions). Supplementary data, such as calibration tables or tables of viewing geometry, used to interpret observational data should also be classified as ‘derived’ data if not easily matched to one of the other three categories.

Sometimes, NASA planetary missions teams use other terms for processing levels, in particular Experiment Data Record (EDR) and Reduced Data Record (RDR). These terms occur frequently in archive documentation and in the Analyst's Notebook itself. “EDR” is equivalent to the PDS Raw processing level. “RDR” is a catchall category that refers to any level of processing beyond the EDR. Specific types of RDR data may be given other names, such as CDR for Calibrated Data Record or DDR for Derived Data Record.

Older archives, particularly those in PDS3 format, sometimes use the Committee on Data Management and Computation (CODMAC) data level number system, shown in the table below.

NASA CODMAC Description
Packet data Raw - Level 1 Telemetry data stream as received at the ground station, with science and engineering data embedded.
Level 0 Edited - Level 2 Instrument science data (e.g., raw voltages, counts) at full resolution, time ordered, with duplicates and transmission errors removed.
Level 1A Calibrated - Level 3 Level 0 data that have been located in space and may have been transformed (e.g., calibrated, rearranged) in a reversible manner and packaged with needed ancillary and auxiliary data (e.g., radiances with the calibration equations applied).
Level 1B Resampled - Level 4 Irreversibly transformed (e.g., resampled, remapped, calibrated) values of the instrument measurements (e.g., radiances, magnetic field strength).
Level 2 Derived - Level 5 Geophysical parameters, generally derived from Level 1 data, and located in space and time commensurate with instrument location, pointing, and sampling.
Level 3 Derived - Level 5 Geophysical parameters mapped onto uniform space-time grids.
Level 4 Ancillary - Level 6 Ancillary data